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Abstract. Uncertainty in the calibration of gravitational- wave (GW) detector data leads 
to systematic errors which must be accounted for in setting limits on the strength of GW 
signals. When cross-correlation measurements are made using data from a pair of instruments, 
as in searches for a stochastic GW background, the calibration uncertainties of the individual 
instruments can be combined into an uncertainty associated with the pair. With the advent 
of multi-baseline GW observation (e.g., networks consisting of multiple detectors such as the 
LIGO observatories and Virgo), a more sophisticated treatment is called for. We describe how 
the correlations between calibration factors associated with different pairs can be taken into 
account by marginalizing over the uncertainty associated with each instrument. 



1. Calibration Uncertainty with One Baseline 

Consider an experiment to measure a physical quantity n (e.g., the stochastic GW background 
strength Q gw (f) [HE])- An optimal combination x of cross-correlation measurements provides 
a point estimate of /x with error bar a. Given a likelihood function p{x\n) and a prior p(fi), one 
can use Bayes's Theorem to construct the posterior 



Due to calibration uncertainties in each of the instruments that make up the baseline for the 
cross-correlation, x is an estimator not of /i, but of A/x, where A is an unknown calibration factor 
(for the baseline) described by an uncertainty e. Thus the likelihood function also depends on 
the calibration factor A 
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so the posterior ([!]) is now constructed from the marginalized likelihood 

p(x\fi) = J d\p(x\fi,X)p(X) . 



If we assume a Gaussian distribution for A, 
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then we can do the marginalization analytically if the range of A values is taken to be (— oc, oc)j^] 
This leads to 
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This is the method used in stochastic GW searches with two LIGO sites, e.g., [SIS]. 

A more physically-motivated prior, which explicitly takes into account that A is multiplicative 
and takes on only positive values, is a log-normal distribution 
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or p(A) 
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where A = In A . 
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This was the approach taken in the stochastic GW search using LIGO and ALLEGRO [5j, but 
has the drawback of requiring numerical integration over A because 



p(x\fi, A) 



aV27r 



exp 



(x - e K jif 
2^ 



(7) 



gives a factor which is not Gaussian in A. Figure [T] compares the posterior distributions for the 
two different choices of priors for different measured values of x and different values of e. 



2. Calibration Uncertainty with Multiple Baselines 

With more than two instruments, there are multiple baselines and multiple calibration 
uncertainties to marginalize over. For instance, the stochastic background search using initial 
LIGO and Virgo data [6j[7] involved 4 different instruments / E {HI, H2, LI, VI} and 5 different 
baselines a E {H1L1, H1V1, H2L1, H2V1, L1V1}. 

Since the cross-correlation measurements for different baselines involve different calibration 
factors, all of the baselines cannot be optimally combined before marginalizing over calibration. 
Instead, all of the measurements for a baseline a can be combined into a single point estimate 
x a with error bar a a . Each baseline has unknown calibration factor X a . Since the statistical 
errors for the different baselines are independent [8], the likelihood is the product 
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1 Since A is an amplitude calibration factor, it should take on only positive values. But for small e — e.g., of order 
0.10 to 0.20 — integrating over A from to oo is numerically the same as integrating over A from — oo to +oo. 




Figure 1. Effects of marginalizing analytically over a single calibration factor for two different 
values of the measured cross-correlation, x = and x = 3a. The thick line is a numerical 
marginalization with a log-normal prior on A; the thin line is an analytic marginalization with 
a Gaussian prior on A. 



where x = {x a } and A = {X a }- The calibration factor X a for each baseline is A/j = and is 
determined by the per- instrument calibration factors £ = {£/}. If each instrument's calibration 
has an underlying uncertainty 5/, the per-baseline calibration factors A have the following means, 
variances and covariances: 

(Xu) = l, (X I jX I j) = 1 + S i 2 + 8j 2 + 0(8 4 ); (XijXjk) = 1 + Sj 2 + 0(8 4 ) if I ^ K . (9) 

2.1. Per-Baseline Calibration Marginalization 

One approach is to marginalize over the per-baseline calibration factors assuming a multivariate 
Gaussian prior p(X). This has the advantage that the marginalization integral 

p(x|/x) = J d\p(x\fi,\)p(\) (10) 

can be done analytically if the integrals over the per-baseline calibration factors A are taken 
over (—00,00). However, the relationship A/j = implies that 

XijXrl - XikXjl = . (11) 

For a multivariate Gaussian prior on A, this relation is true only as an expectation value, not as 
an identity for all values of A/j, \kl, etc. 

2.2. Per- Instrument Calibration Marginalization 

An alternative approach which enforces identities such as (11) is to set a prior which is the 
product of independent priors on each per-instrument calibration factor £/ or equivalently on 
Sj = ln^/. Similarly defining the log-calibration factor for a baseline A a = lnA^, we have 

A u = In X u = ln(£j£j) = S 7 + ~j . (12) 

The likelihood is 
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and the marginalized likelihood is 

p(x\fi) = J d3p(x.\fi,3)p(5) . 

An obvious prior is log-normal on £/, i.e., Gaussian on Ej: 
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The exact integral over S would need to be done numerically for each /i, but if S are small, 
one can make the approximation e AlJ ~ 1 + Ajj = 1 + 5/ + Hj to convert the likelihood to a 
Gaussian integral over S which can be done analytically. The result is a likelihood of the form 
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This is the approach which was used for the multi-baseline upper limits in [7] . 

For the special case of two instruments which make up a single baseline, the matrix M reduces 
to a single number with value 

Comparing (17) to (J5|, we see that this approximation gives the same result as assuming a 
Gaussian prior in A12 with eu 2 = Si 2 + S2 2 . 



3. Ongoing Work 

More generally, we may be using x to estimate multiple physical quantities, such as different 
spherical harmonic modes of a non-isotropic stochastic GW background [9j[T0]. These methods of 
analytic marginalization with either a multivariate Gaussian prior or an approximate likelihood 
function can be applied to the effects of calibration uncertainty in that search as well. 
Additionally, these calibration effects may also be considered in other cross-correlation searches, 
such as the modelled cross-correlation search for periodic GW signals. fTT] 
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